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(57) ABSTRACT 

In a data network, a source node transmits a data packet to 
a destination node across interconnected switches whereby 
a switch, upon receiving the data packet from the source 
node, queries other switches in the network for the appro- 
priate switch and port on the switch out which to forward the 
data packet to the destination node. The appropriate switch 
responds to the query with its switch number and the port 
number of the port out which the data packet should be sent 
to reach the destination node. The querying switch caches 
the switch number and port number and prepends a desti- 
nation tag to subsequent data packets it receives which are 
destined to the same destination node, thereby providing a 
distributed system among the switches in the network for 
maintaining detailed information regarding the appropriate 
switch and port out which to forward data packets received 
by a source node in the network. 

23 Claims, 1 Drawing Sheet 
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METHOD AND APPARATUS FOR 
TRANSMITTING DATA FRAMES BETWEEN 
SWITCHES IN A MESHED DATA NETWORK 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention is related to the field of data 
networks. In particular, the present invention is related to an 
improved method and apparatus for transmitting data frames 
between nodes connected to a meshed data network having 
permanently interconnected switches. 

2. Description of the Related Art 

Traditional data networks include the Ethernet/IEEE 
802.3 Local Area Networks (LAN) and IEEE 802.5 Token 
Ring LAN. These LANs comprise a connectionless oriented 
shared medium over which unicast and broadcast packets 
are transmitted. In contrast, an Asynchronous Transfer Mode 
(ATM) network comprises a connection oriented packet 
switched network. 

Communication between nodes (e.g., workstations, 
servers, bridges, etc.) on separate LANs interconnected via 
an ATM network or between a node on the ATM network 
and a node on the LAN wherein the ATM network and LAN 
are interconnected by, e.g., one or more switches, has been 
accomplished by emulating the LAN in the ATM network so 
that, from the perspective of the nodes, the ATM network is 
transparent, litis service is known in the data networking 
industry as LAN Emulation (LE) service over ATM. LE 
service supports the interconnection of ATM networks and 
LANs using traditional bridging methods and allows 
interoperability between applications on nodes, whether the 
nodes are connected to an ATM network or LAN. 

FIG. 1 provides an example of a data network 100 
comprising, e.g., an IEEE 802.3 LAN 120 and 130 inter- 
connected via an ATM network 110. Connected via segment 
160 to the ATM network 110 is an ATM-based node 170. 
Respectively connected to LANs 120 and 130 are LAN- 
based nodes 140 and .150. With LE service, node 140 can 
communicate with node 170 or 150 utilizing the IEEE 802.2 
LLC, network and transport layer protocols that it would 
otherwise use in a strictly LAN environment. 

LE service is provided for by one or more LAN Emulation 
(LE) Clients (LECs) and a LAN Emulation (LE) service 
comprising an LE Configuration Server (LECS), LE Server 
(LES), and a Broadcast and Unknown Server (BUS). Gen- 
erally speaking, the LECS assigns LE clients to a particular 
emulated LAN, while the LES registers and resolves MAC 
addresses or source route descriptors to ATM addresses, and 
the BUS handles multicast packets and unicast packets with 
an unknown destination address. 

An LE Client is an ATM node such as a switch or node 
identified by one or more Media Access Control (MAC) 
addresses. The LE Service may be centralized or distributed 
across a number of devices such as an ATM node or switch. 
LECs communicate with the LES via control or data Virtual 
Circuit Connections (VCCs). The VCCs may be either 
Switched Virtual Circuits (SVCs) or Permanent Virtual 
Circuits (PVCs). For example, if the data network 100 of 
FIG. 2 supported LE service, switches 210 and 230 may well 
operate as LECs, while switch 220 may perform the function 
of the LES. 

Communication between LECs and the LES is defined 
according to the LAN Emulation User to Network Interface 
(LUNI). LUNI provides for, among other things, initializa- 
tion of LE Clients, registration of MAC addresses repre- 



sented by the LECs, ATM to MAC Address Resolution 
Protocol (LE-ARP), and transferring data from an LE Client 
to another LE Client as part of the LE service. 

A LEC has a separate VCC for transmission of control 

^ packets such as LE-ARP packets and for data packets such 
as IEEE 802.3 frames. Thus, at least one separate VCC 
exists between the LEC and each component of the LES, 
namely, the LECS, the LEC, and the BUS, and in fact, in 
some instances, two VCCs exist between the LEC and LES 

30 component. Given communication occurring between two 
nodes in the network 100, multiple control packets must be 
transmitted between the LEC and LES as well as the data 
packet(s) transmitted between the nodes. What is needed is 
a method and apparatus by which nodes in a network 

15 utilizing LE service may communicate more efficiently, 
without the need for transmission of multiple control packets 
between a LEC representing a particular node and the LES. 
Moreover, such method and apparatus may be applicable to 
any switched network environment. 

20 

BRIEF SUMMARY OF THE INVENTION 

The present invention provides an improved method and 
apparatus by which nodes may transmit data packets over a 

25 fully meshed network topology of permanently intercon- 
nected switches. A source node may transmit a data packet 
to a destination node across interconnected switches 
whereby a switch, upon receiving the data packet from the 
source node, queries other switches in the network for the 

30 appropriate switch and port on the switch out which to 
forward the data packet to the destination node. The appro- 
priate switch responds to the query with its switch number 
and the port number of the port out which the data packet 
should be sent to reach the destination node. The querying 

^ 5 switch caches the switch number and port number and 
prepends such information in the form of a destination tag to 
subsequent data packets it receives which are destined to the 
same destination node, thereby providing a distributed sys- 
tem among the switches in the network for maintaining 

40 detailed information regarding the appropriate switch and 
port out which to forward data packets received by a source 
node in the network. 



45 



BRIEF DESCRIPTION OF THE SEVERAL 
VIEWS OF THE DRAWINGS 

The present invention is illustrated by way of example 
and not limitation in the following figures. Like references 
indicate similar elements, in which: 

FIG. 1 is an illustration of an internetwork as may be 
50 utilized by the present invention. 

FIG. 2 is a further illustration of the internetwork as may 
be utilized by the present invention. 

FIG. 3 is a packet format as may be embodied by the 
55 present invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 



60 



Overview 



The present invention provides an improved method and 
apparatus for transmitting data frames between nodes con- 
nected to a meshed data network having permanently inter- 
connected switches. In the following description, numerous 
65 specific details are set forth in order to provide a thorough 
understanding of the present invention. It will be apparent, 
however, to one of ordinary skill in the art that the present 
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neiworK wnh the switch number ana pon n umber oi ine 
swiich'"po rt out" Which the nbt\6 Is notched . Ihe switch and 
"po rt number asso ciated with a particular node is the desti- 
nation lag (dta g; ror such no cie^ 

Uiven that each switch maintains a table of such dtags, a 
switch is able to forward a data packet destined for a 
particular node, (a destination node) as determined by, e.g., 
the destination MAC address in the header of such data 
packet, not only to the appropriate switch, but to the appro- 
priate port on the switch to which the node is connected, 
thereby saving the switch to which the node is connected 



15 
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invention may be practiced without these specific details. In 
other instances, well-known architectures, circuits, and tech- 
niques have not been shown to avoid unnecessarily obscur- 
ing the present invention. 

In alternative embodiments, the present invention may be 5 
applicable to implementations of the invention in integrated 
circuits or chip sets, wireless implementations, switching 
systems products and transmission systems products. For 
purposes of this application, the terms switching systems 
products shall be taken to mean private branch exchanges 10 
(PBXs), central office switching systems that interconnect 
subscribers, toll/tandem switching systems for interconnect- 
ing trunks between switching centers, and broadband core 
switches found at the center of a service provider's network 
that may be fed by broadband edge switches or access 
multiplexors, and associated signaling, and support systems 
and services. The term transmission systems products shall 
be taken to mean products used by service providers to 
provide interconnection between their subscribers and their 
networks such as loop systems, and which provide 
multiplexing, aggregation and transport between a service 
provider's switching systems across the wide area, and 
associated signaling and support systems and services. 

With refere nce to FIG. 2, a network is illustrated which 
obtains the be nefit of the present invention. An A TM net- 
worl rtttns comprised ol three switches 210, 227) and 230 
f ully interconnected via permanent paths. 240. 250 a nd 260. 
" Connected to switch 220 is ATM node 170 via segment 1 60. 
Etheriid/lELL itbij LAN 120 is connected to ATM net- 
work 110 via switch 210 and LAN 130 is likewise connected 
to ATM network 110 via switch 230. It can be appreciated 
that LANs 120 and 130 may be EEE 802.5 Token Ring 
LANs and that ATM network 110 may be another type .of 
packet switched network, such as Frame Relay or X.25. 

As will be seen, the preferred embodiment of the present 
invention addresses issues with respect to transmission of 
broadcast and multicast packets, address resolution request 
packets, and the forwarding of packets subsequent to 
address resolution. Two types of control packets are utilized: 
Permanent Virtual Circuit (PVC) packets and Address Reso- 
lut ion Protocol (ARP) packets. PVC packets are transmitted 
by switches 210, 220 and 230 to determine if the permanent 
virtual paths between the switches are operational. As will 
be explained, PVC packets utilize a broadcast destination 
tag. ARP packets, on the other hand, utilize a unicast 
destination tag. 

Detailed Description 

According to the present invention, a permanent virtua l 
path exi sts between each switch in a fully meshed netwoT k 
* navi ng a plurality of interconnected switches . Each switch in 
the plur ality of switches has one or more por ts. Each switch, 
'as'Well as each port is associated with an iden tifier, e.g.; a 
number . Each swit ch maintains a table in in ternal memory 
associating the address, e.g., MAC addrcss,~of a node in the 



from having to decode the data packet and determine, based 
on its own table of dtags, the appropriate port out which to 
forward the data packet to the destination node. Moreover, 
unlike the LES in an ATM network providing LE service, a 
distributed system such as utilized by the present invention 
for maintaining destination address resolution information 
provides fault tolerance by avoiding a single point of failure 
in the event a switch maintaining a central repository of 
address resolution information fails. 

Entries in a switch's dtag table are learned and stored in 
the table upon the switch receiving a data packet having a 
destination address not already in the table. Upon such an 
occurrence, the switch queries all other switches in the 
network via a broadcast packet which specifies a dtag 
indicating that the packet is a broadcast packet. The appro- 
priate switch responds to the query with the switch and port 
number of the switch/port to which the node having the 
destination address specified in the data packet is connected. 
The querying switch caches the switch and port number in 
a local dtag table in memory. Subsequent data packets 
received by the switch specifying the same destination 
address are modified by pre pending the dtag to the data 
packet before forwarding the data packet to the appropriate 
port on the appropriate switch. 

As depicted in FIG. 3, the destination tag (dtag) may 
comprise a 2 byte header 310 prepended to a data packet 
340, wherein the first (most significant) byte 320 is a switch 
number field specifying a switch number and the second 
(least significant) byte 330 is a port number field specifying 
a port number. It is appreciated that the dtag is scalable 
depending on the size of the network by increasing the 
length of either of the switch number field or port number 
field or both fields. The data packet 340 includes a destina- 
tion address, a source address, a T/L field, and a data field. 

Unlike traditional bridging methods, the present invention 
provides sufficient information for a switch to fully identify 
the port number of the next switch out which next switch 
will send the data packet that the next switch has received, 
for the next switch to perform a lookup operation in its own 
40 dtag or other address resolution table. The next switch 
receives the modified data packet, parses and strips the dtag 
before sending the data packet out the port identified by the 
dtag. Thus, it is appreciated that a fully meshed topology is 
needed for the present invention to take advantage of the 
45 information maintained by the first switch to receive and 
forward the data packet. 

The present invention simplifies the process of forwarding 
a data packet as compared to the LE service in an ATM 
network. LE service requires transmitting a broadcast packet 
50 via a Broadcast and unknown server (BUS) to determine the 
appropriate switch to which to send a data packet, then 
initiating an LE-ARP via LES, which is a separate and 
second function utilizing additional and separate VCCs. 
Under the presen t invention, a broadcast packe t (having a 
55 broadcast 'drag) i s broadcast to all switches using exi sting 
pe rmanent virtual paths. No c allset up is necessary since the 
pre sent inven tion operates in a hilly connected pe rmanent 
mes rT network topology. In contrast, wherein when a packe t 
is transmitted by a first switch to a second switch using LE 
60 service , it i s still necessary for the second sw itch to parse the 
packet and determine which port t ne packe t should be 
forwarded to . LE Service does not resolve to rwarding deci- 
si ons down to tne pon level Instead, LE service gene rally 
operates according to switched or permanent virtual circuits 
65 at the switch level, which necessitates further packet pro- 
cessing at each switch according to traditional bridging 
methods. 
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In the preferred embodiment of the present invention, 
permanent virtual paths between each of the plurality of 
switches in the fully meshed network topology are verified 
by transmitting broadcast dtags prior to transmitting any 
data packets. Moreover, such broadcast dtags are transmitted 5 
at certain intervals to ensure the permanent virtual paths are 
up and operational and to provide a means by which Hooding 
of broadcasts is achieved. Different broadcast dtags are 
associated with each permanent virtual path. Fo r example, 
switch 210 t ransmits a broadcast to switch 220 with a citaa_ . 
of 11(h), ana transmit s a broadcast lo switch 230 with a dta^i 

The ARP control packet of the present invention diffe rs 
from the TVC verification broadcast packet in that the PVC 
venlication broadcast packet only specifies a broadcast dtag. 
The ARP control packet associates a specific dtag with a 
MAC address, thus, it is a unicast packet, not a broadcast 
packet. For example referring to FICi. 2 . assume a packet .„ 
d estined for node 15flJ s re ceived by switch" 210 from node 
~TC0. I f this is the first packet destined .for; n ode 15Q re ceived 
b y switch 210 , s witch 210 does not know where to send the " 
data packet because there is no entry in switch 210's dtag 
tabic for node 150. The switc h then Hoods the data packet to 
alt switches, e.g., switches 220 and 230. Furthermore, switch 
210 initiates an ARP request by transmitting an ARP control 
packet to the other switches to determine the dtag for node " 
150. The appropriate switch, in this case, switch 230, 
responds, via. an ARP response control packet, to the ARP 
request with its switch number (230) and port number of the 
port connected to LAN 130, over which node 150 is reach- 
able. Switch 220 does not respond since it does not provide 
a direct path to node 150. 

Subsequently, when another data packet is received by 
switch 210 destined for node 150, switch 210 checks its dtag 
table and knows where to send the packet; Not only does ^ s 
switch 210 know to send the data packet to switch (230), it 
also knows which port of switch 230 to send the data packet 
to. Switch 210 then prepends the dtag information to the data 
packet in the form of the dtag header illustrated in FIG. 3. 
Switch 230, upon receiving the data packet, reads the dtag, 4Q 
strips the dtag and sends the data packet out the port to which 
node 150 is connected via LAN 130. This can be done in 
hardware so the process occurs at wire speed. 

What is claimed is: 

1. In a network comprising a plurality of switches inter- 
connected to form a meshed network topology for transmit- 
ting a data packet from a first node to a second node, a 
method comprising: 

receiving a data packet at a first switch coupled to the first 
node; 50 

in response to receiving the data packet, checking in a 
cache of the first switch for a destination lag, the 
destination tag identifying a second switch and a port of 
the second switch to which the second node is coupled; 
and 55 

if the destination tag is in the cache of the first switch, then 
prepending the destination tag to the data packet to 
form a modified data packet for transmission to the 
second switch. 

2. The method of claim 1, further comprising: 60 
if the destination tag identifying the second switch and the 

port of the second switch to which the second node is 
connected is not in the cache of the first switch, then 
broadcasting the data packet from the first switch to the 

plurality of switches; 65 
transmitting a query packet from the first switch to the 

plurality of switches to determine the second switch 
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and the port on the second switch to which the 
second node is connected in order to generate the 
destination lag; ' 
receiving from the second switch a response packet in 
response to the query packet specifying the second 
switch and the port of the second switch to which the 
second node is connected to generate the destination 
tag; and 

sloring the destination tag in the cache of the first 
switch. 

3. The method of claim 1 further comprising: 
transmitting the modified data packet from the first switch 

lo the second switch identified by the destination lag; 
receiving the modified data packet at the second switch; 
parsing the destination tag prepended to the data packet 

from the modified data packet; and 
transmitting the data packet out the port identified by the 

destination tag. 

4. The method of claim 3, further comprising: 

prior to transmitting the data packet out the port identified 
by the destination tag, 

stripping the destination tag prepended to the data 
packet. 

5. The method of claim 1, wherein 

the destination tag comprises a switch number and a port 
number; and 

prepending the destination tag to the data packet com- 
prises prepending the switch number and the port 
number to the data packet. 

6. The method of claim 2 further comprising: 
receiving a second data packet at the first switch coupled 

to the first node; 
checking in the cache of the first switch coupled to the 
first node; 

checking in the cache of the first switch and finding the 
destination tag previously created associated with the 
first and second data packets; and 

prepending the destination tag to the second data packet 
to form a second modified data packet and transmitting 
the second modified data packet from the first switch to 
the second node. 

7. The method of claim 2 further comprising: 
in response to the query packet, 

determining if a node is coupled to a port of a switch 
associated with the destination address of the broad- 
casted data packet. 

8. The method of claim 7 further comprising: 
generating a response packet due to determining that the 

second node is coupled to a port of the second switch 
associated with the destination address of the broad- 
casted data packet, the response packet including the 
switch number and the port number coupled to the 
second node; and 
transmitting the response packet to the first switch. 

9. An article of manufacture, comprising: 

a computer useable medium having computer readable 
program code embodied therein for transmitting a data 
packet received from a first node to a second node 
through a network comprising a plurality of switches 
interconnected to form a meshed network topology, the 
computer useable medium including, 
computer readable program code to receive the data 

packet at a first switch coupled to the first node; 
computer readable program code to check in a cache of 

the first switch for a destination tag in response to 
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receiving the data packet, the destination tag identi- 
fying a second switch and a port of the second switch 
to which the second node is coupled; and 
if the destination tag is in the cache of the first switch, 
then 5 
computer readable program code to prepend the 
destination tag to the data packet to form a modi- 
fied data packet. 

10. The article of manufacture of claim 9, further com- 
prising if the destination tag identifying the second switch 10 
and the port of the second switch to which the second node 

is coupled is not in the cache of the first switch: 
computer readable program code to 

i) broadcast the data packet from the first switch to the 
plurality of switches; ^ 

ii) transmit a query packet from the first switch to the 
plurality of switches to determine the second switch 
and the port of the second switch to which the second 
node is coupled; 

iii) receive from the second switch a response packet in 20 
response to the query packet that specifies the des- 
tination tag identifying the second switch and the 
port of the second switch to which the second node 

is coupled; and 

iv) store the destination tag in the cache of the first 25 
switch. 

11. The article of manufacture of claim 9 further com- 
prising: 

computer readable program code to transmit the modified 

data packet from the first switch to the second switch 30 

identified by the destination tag; 
computer readable program code to receive the modified 

data packet at the second switch; 
computer readable program code to parse the destination 35 

tag prependecl to the data packet from the modified data 

packet; and 

computer readable program code to transmit the data 
packet out the port identified by the destination tag. 

12. The article of manufacture of claim 11, further com- 40 
prising computer readable program code to strip the desti- 
nation tag prepended to the data packet prior to transmitting 
the data packet out the port identified by the destination tag. 

13. The article of manufacture of claim 9, wherein the 
destination tag comprises a switch number and a port 45 
number and wherein the computer readable program code to 
prepend the destination tag to the data packet includes 
computer readable program code to prepend the switch 
number and the port number to the data packet if the 
destination tag is in the cache. 50 

14. The article of manufacture of claim 9 wherein the 
computer useable medium is one or more of the set of 
magnetic storage 1 medium, optical storage medium, or semi- 
conductor storage medium. 

15. A method of transmitting data packets between a node 55 
of a first network to a node of a second network over a 
meshed network of switches, without decoding the data 
packets at every switch to determine the destination address, 
the method comprising: 

maintaining a table of destination tags in each of the 60 
switches of the meshed network of switches, the table 
of destination tags identifying the switches and ports of 
the switches to which the nodes of the first and second 
networks arc coupled; 



prepending a destination tag to the data packets forming 
modified data packets, the destination tag associated 
with the destination of the data packets through the 
meshed network of switches; and 

transmitting the modified data packets through the 
meshed network of switches between the first and 
second networks in response to the destination tag. 

16. The method of claim 15 for transmitting data packets, 
the method further comprising: 

prior to prepending the destination tag to the data packets, 
receiving the data packets from the first or second 
network for transmission to the second or first network 
respectively. 

17. The method of claim 15 for transmitting data packets, 
the method further comprising: 

parsing the destination tag and the data packets from the 
modified data packets, transmitting the data packets to 
the first or second network in response to the destina- 
tion tag. 

18. The method of claim 15 for transmitting data packets, 
the method further comprising: 

prior to maintaining the table of destination tags in each 
of the switches of the meshed network of switches, 
generating the table of destination tags in a switch of 
the meshed network of switches by transmitting broad- 
cast type destination tags from the switch to each other 
switch in the meshed network of switches and receiving 
a response packet indicating the switch and port num- 
ber of the switch to which the first or second network 
is coupled. 

19. A computer data signal embodied in a bit stream 
between a node of a first network and a node of a second 
network in a meshed network of switches, the computer data 
signal comprising: 

at least one byte indicating a switch number of a switch 
to which a node of the first or second network is 
coupled, and 

at least one byte indicating a port number of a port of the 
switch to which the node of the first or second network 
is coupled, 

the at least one byte indicating the switch number and the 
■ at least one byte indicating the port number preceding 
a data packet to form a modified data packet for 
communication over the meshed network of switches. 

20. The computer data signal of claim 19 wherein the data 
packet includes 

a destination address and a source address of the data 

packet, and 
data. 

21. The computer data signal of claim 19 wherein the at 
least one byte indicating a switch number and the at least one 
byte indicating a port number are a destination tag 
prepended to the data packet to form the modified data 
packet. 

22. The computer data signal of claim 19 wherein the bit 
stream is communicated over network media. 

23. The computer data signal of claim 22 wherein the 
network media is one of the set of cable, wireless carrier 
waves, and optical fiber. 
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